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ADAPTIVE MEDIA MESSAGING, SUCH AS FOR RICH MEDIA MESSAGES 
INCORPORATING DIGITAL CONTENT 

TECHNICAL FIELD 

[0001] The present invention is directed to the field of media delivery techniques. 

BACKGROUND 

tooo2] Electronic mail ("email") is a form of Internet Protocol (IP) messaging that 

has proven a useful medium for several different types of communications. In 
particular, email has been used to deliver marketing messages to single recipients 
and groups of recipients. 

[0003] Initially, such email-conveyed messages were expressed in plain-text 

format. One advantage of the plain-text format is that recipients can read such 
messages no matter what email client program ("email client") they use. A 
significant disadvantage of the plain-text format is that its display is 
undistinguished and unattractive relative to other types of visual displays possible 
on many computer systems, and is in that sense poorly suited to direct 
promotional marketing and other high impact business communications. 
Furthermore, recipient activity with the message cannot be tracked, representing 
another significant business limitation, 

[0004] Since the advent of email clients capable of sending and receiving email in 

HTML format, some IP messages have been expressed in HTML format. While 
this facilitates somewhat richer and more colorful displays than plain-text format, 
such messages are typically static, not trackable, and still relatively poorly suited 
to achieve high impact with recipients. 

[0005] In view of the disadvantages of conventional kinds of IP messages such as 

those discussed above, new kinds of IP messages that include multi-media 
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elements and that can adapt to the capabilities of a recipient's computer system 
would have significant utility. Such adaptive IP messages could be used, for 
example, to replace mailed print brochures with interactive multi-media brochures, 
or improve the effectiveness of email marketing campaigns. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] Figure 1 is a block diagram showing typical configurations of and 

connections between computer systems on which the facility operates. 
[0007] Figures 2-7 are conceptual diagrams showing typical adaptation and 

display of a sample adaptive media package. 
[0008] Figure 8 is a flow diagram showing the adaptation and display of an 

adaptive media package. 
[0009] Figure 9 is a flow diagram showing the steps typically performed by the 

facility in order to monitor the operation of the adaptive media package. 
[0010] Figures 10-18 are display diagrams showing the display of various different 

layers of a sample adaptive media package. 
[0011] Figure 19 is a display diagram showing a typical user interface provided by 

the facility to obtain information used to generate an instance of an adaptive 

media package. 

[0012] Figure 20 is a display diagram showing a typical report generated by the 

facility. 

DETAILED DESCRIPTION 

[0013] A software facility is provided for presenting rich media adaptive IP 

messages ("the facility") containing rich media elements such as audio, video with 
or without audio, a variety of digital content. For example, the adaptive IP 
messages presented by the facility can contain digital content elements including 
multi-media and/or rich media elements, animation with or without audio, text, or 
images. In various embodiments, the facility generates, delivers, remotely 
supports, and tracks adaptive media packages containing digital content 
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elements, such that the facility automatically adapts itself to render the digital 
media elements it contains differently on different recipients' computer systems 
based upon the particular media capabilities of each computer system, thus 
providing the most engaging version of the message possible on each recipient 
computer system. 

[0014] In some embodiments, the facility provides authoring tools for generating 

multiple versions, or "layers" of an IP message to be delivered to one or more 
recipients, such as an email message, each layer optimized for display on 
recipient computer systems having different sets of digital content and other 
capabilities. The authoring tools receive, for each of one or more digital content 
elements such as a video sequence, a single version of the digital content 
element, as well as information such as an image specifying an environment for 
the digital content element(s). The authoring tools transform the received 
information into a number of different layers, each of which contains different 
versions of the digital content elements(s) in the context of the specified 
environment. Such different versions of the digital content element(s) may 
include versions that utilize different kinds of media players (such as video 
players and animation players) or programs of other kinds; versions that consume 
different levels of recipient computer system resources such as bandwidth, 
computing power, or memory; etc. The authoring tools may also add links or 
other user interface controls to the layers to enable recipients to get further 
information about the message, forward the message to another recipient, request 
to not receive similar messages in the future, etc. Any given layer may be either 
pre-generated, or dynamically generated in response to each request for the 
layer. 

[0015] In addition to generating the different layers of the message, the authoring 

tools may also generate client-side tests for testing the recipient computer system 
capabilities and selecting the most appropriate layer of the message based upon 
the results of the tests. The authoring tools may also generate server-side tests 
for incorporating other media elements in the IP message for certain recipients 
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based upon earlier tracking results for those recipients. For example, for an IP 
message whose primary digital content element is a video clip featuring a 
particular character, such a test may determine that, because a particular 
recipient consistently stopped early in viewing video clips included in earlier IP 
messages featuring the same character, this recipient should instead receive an 
alternate video clip in which the character does not appear. 
[0016] In some embodiments, the facility includes an email message generating 

component that begins with an initial one of the layers of the message, and adds 
(1) client-side scripts and (2) recipient-specific customization information. The 
added client-side scripts perform such functions as: reporting on the opening of 
the email message; testing the digital content capabilities of the recipient 
computer system; selecting the most appropriate layer of the message based 
upon the results of the tests; and replacing the contents of the message with the 
selected layer. The recipient-specific customization information may include 
special information designed to appeal specifically to the recipient, such as the 
recipient's name, or a message thanking the recipient for making a recent 
purchase. 

[0017] When one of these email messages is received on a recipient computer 

system, it is stored in an email inbox on the recipient computer system. When the 
recipient opens, the email message, the initial layer is displayed within the email 
message. The initial layer typically contains an image tag that causes the 
downloading of a very small image from the server computer system, thereby 
notifying the server computer system of the opening of the message for tracking 
purposes. Other layers of the adaptive media package also typically contain such 
an image tag, similarly facilitating the tracking of their opening. 

[0018] If script processing functionality is available and enabled for HTML email 

messages, the scripts in the email are executed in order to test the media 
capabilities of the recipient computer system; select the most appropriate layer of 
the message based upon the results of the tests; and replace the contents of the 
message with the selected layer. If script processing functionality is not available 
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or not enabled for HTML email messages, the scripts in the email message do not 
execute. Accordingly, the initial layer of a message typically includes a link that 
the recipient may traverse in order to open the first layer in a browser window, 
which similarly reports on the opening of the IP message; tests the media 
capabilities of the recipient computer system; selects the most appropriate layer 
of the message based upon the results of the tests; and replace the contents of 
the browser window with the selected layer. 

[0019] While the initial and any subsequent layer of the IP message is open, the 

facility typically monitors actions taken by the recipient with respect to the 
message, such as the layer ultimately used, the amount of time the message was 
open or the digital content element was playing, the links in the message followed 
by the recipient, etc. In some embodiments, the facility also collects additional 
information, such as the configuration of the recipient's computer system, the total 
number of times the recipient views the IP message, etc. Such information is 
typically collected by server computer and systems, such as web servers and 
media servers, that serve data needed to support the operation of adaptive media 
packages. Such data is requested using links stored inside each adaptive media 
package, which are typically encoded with an indication of the recipient's identity 
so that information collected from a recipient can be associated with the 
recipient's identity. The recipients' activity information can be recorded in real- 
time or delayed, depending on requirements and configuration. 

[0020] In some embodiments, the facility may collaborate with other software 

applications, such as those that manage the actual sending of the adaptive media 
packages, and/or those that store, analyze, or otherwise consume the results of 
tracking the adaptive media packages. These other applications can include 
CRM or other contact-management, customer tracking, or workflow applications, 
as well as applications of various other types. Additionally, some embodiments of 
the facility provide native addressing and reporting modules, such as those that 
provide their own user interfaces. 
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[0021] Figure 1 is a block diagram showing typical configurations of and 

connections between computer systems on which the facility operates. Figure 1 
shows one or more server computer systems 100 connected via a network such 
as the Internet 199 to a recipient computer system 150. It will be appreciated by 
those of skill in the art that any number of recipient computer systems may be 
similarly connected to the server computer systems. It will also be appreciated by 
those of skill in the art that resources and/or functionalities shown in the server 
computer system 100 may be duplicated on or distributed across a number of 
different server computer systems. 

[0022] The recipient computer system 150 includes memory 160, whose contents 

may be stored in volatile memory devices, persistent memory devices, or a 
combination of the two; one or more central processing units ("CPUs") 171 for 
executing programs; a display device 172 such as a video monitor for displaying 
visual information, including email client windows and their contents, browser 
windows and their contents, and digital content elements; a keyboard 173 for 
inputting text; a pointing device 174, such as a mouse, for selecting locations on 
the display device; and an audio device 175 for rendering audio sounds and 
sequences, such as those that are part of an adaptive media package. The 
memory 160 includes programs such as an email client 161, a web browser 
program 162, and one or more media player programs 163. 

[0023] The server computer system 100 includes one or more central processing 

units ("CPUs' 1 ) 131, as well as memory 110, whose contents may be stored in 
volatile memory devices, persistent memory devices, or a combination of the two. 
The memory contains an adaptive media package ("AMP") authoring program 
111, which is used to generate an adaptive media package, made up of: IP 
message templates 122, which are transformed into individual IP messages 
embodying the initial layer of the adaptive media package for delivery to recipient 
computer systems by an IP message sending program 112; web server data 123 
for delivery by web server program 113 in response to requests generated by the 
recipient computer system as a result of receiving the IP message, including 
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manifestations of the additional layers of the adaptive media package, and other 
elements needed by the message, such as static images; and media server data 
125, such as audio sequences, video sequences with or without audio, or 
animation sequences with or without audio, that are incorporated in layers of the 
adaptive media package and delivered to the recipient computer system by a 
media server program 115 in response to requests from the recipient computer 
system after receiving the IP message. The memory may also contain an active 
server page engine 1 14 for processing active server pages among the web server 
data that are requested in requests presented to the web server program, and/or 
for processing active server pages among the IP message template that are sent 
by the IP message sending program. The memory typically also includes a data 
collection program 116 for collecting collected data 126 describing the sending of 
adaptive media packages to each of a number of recipients, as well as 
subsequent processing for those alternative media packages that relates to how 
they are used on the recipient computer systems. 

[0024] While computer systems configured as described above are typically used 

to support the operation of the facility, those skilled in the art will appreciate that 
the facility may be implemented using devices of various types and 
configurations, and having various components. 

[0025] Figures 2-7 are conceptual diagrams showing typical adaptation and 

display of a sample adaptive media package. Figure 2 shows the IP message 
200 as it is initially delivered to the recipient computer system. The IP message 
includes a message header 201, as well as HTML contents 210 embodying the 
initial layer of the adaptive media package. The initial layer typically includes 
visual information that provides a visual context for the digital content element of 
the adaptive media package, such as a static image. In some embodiments, this 
static image is divided into a number of smaller panels, which are requested 
separately by separate inclusion links in the initial layer and displayed in an 
arrangement that forms the image. The initial layer typically does not contain any 
digital content elements. Rather, the initial layer includes an inclusion link 212 to 
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one or more scripts for testing the capabilities of the recipient computer system 
and selecting the appropriate layer of the message to ultimately display. As is 
discussed in conjunction with Figures 3-5 below, if IP message 200 is opened in 
an email client program that supports HTML message scripting, inclusion link 212 
is given effect in order to incorporate the testing and selecting scripts into email 
message 200, then execute them to ultimately replace replaceable section 211 of 
the email message with data embodying the selected layer. As discussed below 
in conjunction with Figures 6 and 7, if email message 200 is displayed in a 
manner that does not support HTML scripting, such as an email client that does 
not have that capability, an email client in which that capability is disabled, or a 
special mode of an email client in which that capability is unavailable, such as a 
preview pane, then the user may click on a traversible link 213 to a browser- 
based version of the adaptive media package, in order to test the capabilities of 
the recipient system, select an appropriate layer, and display the selected layer in 
a web browser window. 

[0026] Figures 3-5 show stages in the process of displaying the adaptive media 

package within the original IP message, which the facility can accomplish if script 
processing is available and enabled. Figure 3 shows the appending to email 
message 200 of the test and select scripts 320 referenced in inclusion link 212. 
In some embodiments, the test and select scripts 320 are a number of different 
files that are serially chained into the IP message 200. The test and select scripts 
both (1) test capabilities of the recipient computer system relevant to the display 
of various types of digital content elements, and (2) select an appropriate layer of 
the adaptive media package based upon the results of the testing. 

[0027] In various embodiments, testing includes system resources such as 

communications bandwidth, processor speed, available or total memory, etc. For 
example, a determination of communications bandwidth can assist in the decision 
of whether to select layers containing the digital content elements whose total size 
is large versus small. Bandwidth testing may be performed, for example, by 
downloading a body of data of a known size, preferably from the server containing 
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the media server program, determining the amount of time elapsed during the 
download, and dividing the former by the latter. In various embodiments, the tests 
determine whether certain programs are installed and available for use, such as 
certain versions of a video player, such as the Microsoft Windows Media player, 
and animation players, such as certain versions of the Macromedia Flash player. 
Such tests may be performed in various ways, such as reading the recipient 
computer system's registry or other locations in its persistent memory to 
determine whether the particular program has been installed; attempting to 
instantiate an instance of the particular player; etc. 

[0028] Depending upon the results of these tests, the scripts select the most 

appropriate layer of the message. In some cases, this is the most aggressive type 
of digital content element for which a player is available on the recipient computer 
system, in a size that is compatible with the bandwidth to the recipient computer 
system. Where none of the tested-for players are available on the recipient 
computer system, a layer may be selected that includes controls such as a link for 
downloading and installing one of these players. 

[0029] The test and select scripts 320 include an inclusion link 321 to a script for 

downloading the selected layer and substituting it in the email message for the 
replaceable section. 

[0030] Figure 4 shows the inclusion in the IP message of script 430 for replacing 

the replaceable section 21 1 with data embodying the selected layer. The replace 
script typically includes the data with which the replaceable section 211 will be 
replaced by the replace script. In some cases, this replacement data is included 
in the replace script in an encoded form, such as in Unicode form. Where the 
replacement data is encoded, the replace script decodes it. For instance, where 
the replacement data is encoded in Unicode form, the facility decodes the 
replacement section using an "unescape" function. The replace script further 
replaces the replaceable section with the replaced section. In some 
embodiments, this involves assigning the decoded replacement section data to an 
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innerHTML document object model property of a DIV grouping element 
corresponding to the replaced section. 

[0031] Figure 5 shows the result of executing the replace script 430. It can be 

seen by comparing Figure 5 to Figure 4 that replaceable section 211 has been 
replaced with replaced section 51 1, which embodies the layer selected by the test 
and select script. The replaced section embodying the selected layer includes a 
version 513 of the digital content element in a particular media element type that 
is appropriate for the recipient computer system. The displayed digital content 
element is typically displayed in the context of other visual information, such as a 
static image, which may be downloaded from the server computer system 
piecemeal as described above. 

[0032] Figures 6 and 7 show the display of the adaptive media package in a 

separate browser window when scripting in the IP message cannot be processed. 
Figure 6 shows the traversal by the user of traversible link 213 to a browser- 
based version of the adaptive media package. When this link is traversed, such 
as by clicking on it, a new browser window 600 is opened. The browser window 
contains browser controls 601 as well as the data downloaded using the 
reference stored in the traversible link. This data includes browser-based test 
and select scripts 610 that are similar to test and select scripts 320, and perform a 
similar function. The data loaded into the browser also includes a redirect link 
620 to a web page containing the layer selected by the test and select scripts. 
Once the test and select scripts execute to test the capabilities the recipient 
computer system and select an appropriate layer, the redirect link loads a web 
page embodying the selected layer into browser window 600. 

[0033] Figure 7 shows the display of the selected layer 702 in the browser window 

700. The selected layer contains a version 703 of the digital content element as 
appropriate for the recipient computer system. The displayed digital content 
element is typically displayed in the context of other visual information, such as a 
static image, which may be downloaded from the server computer system 
piecemeal as described above. 
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[0034] In some embodiments, the subsequent layers of the adaptive media 

package are downloaded from the web server as active server pages, or other 
templates supporting server-side scripting. This enables the facility to adapt the 
specific contents of the layer in a number of ways, including: encoding the links in 
the layer with the recipient's recipient identifier, so that subsequent dereferencing 
of any of these links identifies the recipient as the dereferencer for tracking 
purposes; including customized visual information, such as the recipient's name, 
or a message based upon the recipient's activity; alternative digital content 
elements that tracking of the recipient reveals are better-suited to the recipient 
than the primary digital content elements for the adaptive media package; etc. 
[0035] Figure 8 is a flow diagram showing the adaptation and display of an 

adaptive media package. In step 801, an IP message containing the initial layer 
of the adaptive media package is delivered to the recipient computer system. The 
IP message contains a traversible link to a layer selector for browser-based 
viewing of the adaptive media package, as well as an inclusion link for test and 
replace scripts that support email message-based viewing of the adaptive media 
package. In step 802, if HTML messages are supported by the email client on the 
recipient computer system, then the facility continues to step 803, else the facility 
continues in step 806. In step 803, if JavaScript is enabled for the IP message as 
currently displayed, then the facility continues in step 804, else the facility 
continues in step 807, In step 804, the inclusion link is dereferenced to load and 
execute scripts to determine the relevant system characteristics of the recipient 
computer system, select an appropriate layer based upon those characteristics, 
retrieve the selected layer from the server, and substitute the selected layer into 
the IP message for the initial layer. In step 805, the facility displays the IP 
message containing the substituted layer, which includes the version of the digital 
content element or elements contained in the substituted layer. In step 806, 
though HTML IP messages are not supported by the email client, a portion of the 
email message in plain text is displayed and contains a link to a layer selector 
web page for browser-based viewing of the adaptive media package. Similarly, in 
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step 807, the rendered HTML IP message containing the initial layer is displayed, 
which also includes a link to the layer selector web page for browser-based 
viewing of the adaptive media package. In step 808, one of these links is 
traversed by the recipient. In step 809, the web page containing the layer 
selector is loaded into a new browser window. The scripts included in this web 
page are executed to determine the relevant system characteristics, select a layer 
that is appropriate in light of these characteristics, and redirect the browser to a 
web page embodying the selected layer. In step 810, the selected layer is 
displayed in the browser window, including one or more digital content elements 
of the appropriate type. 

[0036] Figure 9 is a flow diagram showing the steps typically performed by the 

facility in order to monitor the operation of the adaptive media package. In step 
901, the facility receives in a server computer system a web server or media 
server request triggered by the adaptive media package. These requests typically 
include a recipient identifier that was encoded into the adaptive media package 
during its generation. In step 902, the facility handles the request received in step 
901 . In step 903, the facility forwards the relevant information from the request 
received in step 901, including the recipient identifier, to a data collection 
program. The data collection program compiles such information for each 
recipient, and makes it available for reporting and other analysis. After step 903, 
the facility continues in step 901 to receive the next request. 

[0037] Figures 10-18 are display diagrams showing the display of various different 

layers of a sample adaptive media package. Figure 10 is a display diagram 
showing the display of the initial layer of the adaptive media package. The 
display occurs in the window 1000 of the recipient computer system's email client. 
The email client contains an in-box 1010 for received email messages, which in 
■ turn contains the email message 1011 containing the adaptive media package. 
The contents of this message are shown in a preview pane 1020 of the email 
client. In the preview pane, both the email header 1021 and the email contents 
1022 are shown. Because this email client does not execute scripts for messages 
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whose contents are shown in its preview pane, the script in the email message 
does not execute, and the initial layer of the adaptive media package continues to 
be displayed. This layer includes traversible link 1023, which the recipient may 
click in order to display the adaptive media package in a separate web browser 
window. 

[0038] Figure 1 1 shows the display of a subsequent layer of the adaptive media 

package in the context of the IP message. An IP message window 1 100 has been 
opened which contains the email header information 1111, as well as the 
message contents 1120. Because scripts are executed within separate email 
message windows by this email client, the script in email has executed to replace 
the first layer of the adaptive media package shown in Figure 10 with a 
subsequent layer 1121. This layer includes an animation version 1122 of the 
digital content element, which will automatically commence playing. A layer such 
as this one is typically displayed on a recipient computer system on which a video 
media player is not available, but an animation player is, or a recipient computer 
system on which a limited amount of bandwidth of available. 

[0039] Also contained in this layer, as well as many of the other layers of the 

adaptive media package, are links and other controls that enable the recipient to 
obtain further information about the message, forward the message to another 
recipient, request to not receive similar messages in the future, etc. Here, these 
links and controls include a link 1123 to obtain further information about the 
message; field 1125 and send link 1126 for forwarding the message to another 
recipient; link 1127 to obtain assistance in using the message; and link 1128 to 
unsubscribe from the mailing list that caused the message to be sent to the 
recipient. 

[0040] Figure 12 is a display diagram showing the display of a layer containing a 

high-quality video version 1222 of the digital content element in the context of the 
IP message. A layer such as this one is typically displayed on a recipient 
computer system on which a video media player is available, and a high amount 
of bandwidth is available. 
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[0041] Figure 13 is a display diagram showing the display of a subsequent layer of 

the adaptive media package containing a low-quality video version 1322 of the 
digital content element in the context of the IP message. A layer such as this one 
is typically displayed on a recipient computer system on which a video media 
player is available, but only an intermediate amount of bandwidth is available. 

[0042] Figure 14 is a display diagram showing a subsequent layer of the adaptive 

media package in the context of the IP message that does not immediately 
contain any version of the digital content element. A layer such as this one is 
typically displayed on a recipient computer system where neither a video media 
player nor an animation player is available. This layer includes a link 1422 that 
the user may traverse in order to download and install a video player, and use it 
to view a version of the digital content element. 

[0043] Figures 15-18 are display diagrams showing the display of a subsequent 

layers of the adaptive media package in a web browser window. Figure 15 is a 
display diagram showing a subsequent layer of the adaptive media package 
containing an animation version 1522 of the digital content element. 

[0044] Figure 16 is a display diagram showing a subsequent layer of the adaptive 

media package containing a high-quality video version 1622 of the digital content 
element that is displayed in a web browser. 

[0045] Figure 17 is a display diagram showing a subsequent layer of the adaptive 

media package containing a low-quality video version 1722 of the digital content 
element that is displayed in a web browser. 

[0046] Figure 18 is a display diagram showing a subsequent layer containing a 

traversible link 1822 for retrieving and installing a suitable video media player that 
is displayed in a web browser. 

[0047] In some embodiments, the facility generates additional sets of layers to 

accommodate different browsers, different script interpretation engines in use on 
the recipient computer system, etc. 

[0048] Figure 19 is a display diagram showing a typical user interface provided by 

the facility to obtain information used to generate an instance of an adaptive 
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media package. The user interface includes a form 1900, which contains a 
number of controls that a user may use to input information used to generate an 
instance of an adaptive media package: a recipient email address field 1901, into 
which the user may enter one or more email addresses to which the adaptive 
media package instance is to be sent; a subject line field 1902, into which the 
user may enter a subject line for the email message conveying the adaptive media 
package instance; a sender name field 1903, into which the user may enter a 
name identifying the sender of the adaptive media package instance; a sender 
email address field 1904, into which the user may enter an email address for the 
sender of the adaptive media package instance; a sender phone number field 
1905, into the user may enter a phone number for the sender of the adaptive 
media package instance; a personalized message field 1906, into which the user 
may enter a text message to be included in the adaptive media package instance; 
a media element selection list box 1907 that the user may use to choose a media 
element for inclusion in the adaptive media package instance from among a 3-D 
model media element 1908 that may be rotated and explored by the recipient of 
the adaptive media package instance, and a video clip media element 1909 that 
may be viewed by the recipient of the adaptive media package instance; a related 
link 1 field 1910, into which the user can enter the URL of a first related web 
page, and a related link 1 name field 1911, into which the user may enter text for 
a link to the first related web page that will appear in the adaptive media package 
instance; a related link 2 field 1912 and a related link 2 name field 1913, into 
which the user can enter information used to create a link to a second related web 
page in the adaptive media package instance; a copy to me checkbox 1914 that 
the user may check in order to send a copy of the adaptive media package 
instance to the sender email address entered into sender email address field 
1904; a return receipt checkbox 1915 that the user may check in order to request 
return receipts from the addressees of the adaptive media package instance; a 
link 1916 that the user may traverse in order to preview the adaptive media 
package instance; a send message button 1917 that the user may select in order 

[31825-8002US01/SL030400.006] -1 5- 



to send the adaptive media package instance as specified; a clear form button 
1918 the user may select in order to clear the data entry controls; a preview 
thumbnail 1921 that shows a preview of the adaptive media package at reduced 
size; a view sample email link 1922 that the user may traverse in order to view a 
sample email; a help me with this form link 1923 that the user can traverse in 
order to obtain additional instructions about using this user interface; and a 
sending to multiple recipients link 1924 that the user may traverse when 
addressing the adaptive media package to a number of recipients. 
[0049] In some embodiments, the facility uses the data it has collected about a 

delivery and use of adaptive media packages to produce reports. Such reports 
may reflect such information as: the total number of different recipients that 
opened the IP message at least once (typically available from the web server); the 
total number of times the IP message was opened, including multiple opens from 
the same recipient (typically available from the web server); the number of times 
recipient traversed links in the message (typically available from the web server); 
the number of times a video stream was requested (typically available from the 
media server); the percentage of recipients who watched digital content 
sequences to completion (typically available from the media server); a breakdown 
of the number of recipients that watched a percentage of the digital content 
sequence within each of a number of blocks of percentages (typically available 
from the media server); the percentage of requests for a digital content sequence 
that occurred in each of a number of different time periods during the day 
(typically available from the media server); the percentage of recipients having 
bandwidth measured in each of a number of different ranges (typically available 
from the media server); the number of recipient computer systems running each of 
a number of different operating systems (typically available from the media 
server); the number of recipients in each of a number of different countries or 
locations (typically available from the media server); the number of recipients 
requesting the digital content sequence on each of the days of the week (typically 
available from the media server); and the length of time each recipient kept the 
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adaptive media package IP message opened (typically available from the web 
server). Those skilled in the art will appreciate that some sets or supersets of this 
information may be included in a report. 

[0050] Figure 20 is a display diagram showing a typical report generated by the 

facility. The report 2000 includes details about the delivery and use of a 
particular message identified by message number 2001, such as a message 
conveying an adaptive media package. The information includes an initial 
delivery date 2002; information 2003 identifying a message template from which 
the message was generated; a sender address 2004; subject line text 2005; an 
indication 201 1 of the number of different times the message has been sent; an 
indication 2012 of the number of times the message has been opened; an 
indication 2013 of the number of unique users that have opened the message; 
and an indication 2014 of the number of times the message has been forwarded 
to another address by a addressee. 

[0051] The report includes a delivery history section 2020 containing information 

about each time the message has been sent. The delivery history section 
includes a subsection for each time the message has been sent. Each subsection 
includes a time stamp such as time stamp 2021 showing the date and time at 
which the message was sent, and a list of the email addresses such as email 
addresses 2022 and 2023 to which the message was sent. 

[0052] The report includes an activity totals section 2030 containing information 

about the total number of times any of the addressees have performed each of a 
tracked group of actions relative to the message. The activity totals section 
identifies the total number of times each of a tracked group of actions 2031 -2041 
were performed by addressees of the message. 

[0053] The report includes an addressee activity section 2050 containing 

information about the number of times each addressee has performed each of the 
tracked group of actions relative to the message. The addressee activity section 
contains a row for each addressee of the message. Each row contains the 
following information: the email address 2061 of the addressee; an indication 
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2062 of the number of times the addressee has opened the message; an 
indication 2063 of the number of times the addressee has forwarded the 
message; an indication 2064 of the number of times the addressee has traversed 
a video link in the message; an indication 2065 of the number of times the 
addressee has traversed a logo link in the message; an indication 2066 of the 
number of the times the addressee has traversed a home page link; an indication 
2067 of the number of times that the addressee has traversed a buy link; an 
indication 2068 of the number of times the addressee has traversed a link to view 
a 3-D model; an indication 2069 of the number of times the addressee has 
traversed an opt in link; an indication 2070 of the number of times that the 
addressee has traversed an opt out link; an indication 2071 of the number of 
times the addressee has traversed a ready to buy link; an indication 2072 of the 
number of times the addressee has traversed a h2f link; an indication 2073 of the 
number of times the addressee has traversed a first custom link; an indication 
2074 of the number of times the addressee has traversed a second custom link. 

[0054] The report includes a layer activity section 2080 containing information 

about the number of times each addressee has viewed each layer of the 
message. The layer activity section contains a row for each addressee of the 
message. Each row contains the email address 2091 of the addressee; an 
indication 2092 of the number of times the addressee viewed a first, preview layer 
of the message; an indication 2093 of the number of times the addressee viewed 
a second, large video layer of the message; an indication 2094 of the number of 
times the addressee viewed a third, small video layer of the message; an 
indication 2095 of the number of times the addressee viewed a fourth, flash layer 
of the message; and an indication 2096 of the number of times the addressee 
viewed a fifth layer of the message containing no media element. 

[0055] It will be appreciated by those skilled in the art that the above-described 

facility may be straightforwardly adapted or extended in various ways. For 
example, the facility may be used to deliver various kinds of messages other than 
direct email messages, and may adapt various types of content other than digital 
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content content. While the foregoing description makes reference to preferred 
embodiments, the scope of the invention is defined solely by the claims that follow 
and the elements recited therein. In addition, while certain aspects of the 
invention are presented below in certain claim forms, the inventors contemplate 
the various aspects of the invention in any available claim form. For example, 
while only some aspects of the invention may currently be recited as being 
embodied in a computer-readable medium, other aspects may likewise be so 
embodied. 
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